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CHAPTER  1 

INTRODUCTION 

In  the  following  pages  we  investigate  processes  Xt  taking  values  in  a locally 
convex  topological  vector  space  X and  satisfying  the  equation 

E[Xt+s\Xt)  = AsXt 

for  some  semigroup  {At',t  > 0}  acting  on  Ah  We  shall  largely  restrict  ourselves  to 
the  case  of  a dual  Banach  space  equipped  with  a wk*— topology,  and  in  the  case  of 
discrete-time  process  it  is  assumed  that  the  process  takes  values  in  or  C*  for  some 
d > 1.  As  a motivation  for  the  endeavor,  consider  the  following  examples. 

(Example  1)  Let  (D,  JF,  J-n,  P ) be  a filtered  probability  space,  a a real  number 
between  zero  and  one,  and  Xn  € Tn  an  L1— bounded  process  such  that 

E[An_(. j jjE rc]  — qA„  T (1  a)Xn-\ 

for  all  n — 0, 1, 2, ... . We  have 

E[Xn+1  + (1  - a)Xn\fn)  = Xn  + (1  - q)W„-i 

as  is  readily  verified,  so  the  Tn— adapted  process  Yn  = Xn  + (1  — a).A„_i  is  a 
Tn  —martingale.  Denote  by  Y/yo  the  limit  Yn  — > YrXj  as  n — > oo.  Solving  for  Xn 
we  obtain  the  following 

A ti  In  (1  o)An_i 

= Yn  - (1  - ot)(Yn-x  - (1  - <y)Xn—2 ) 

= Yn  — (1  — o)Yn— i + (1  — a)2Xn- 2 (11) 

n 

= ]T(a-  1 )fcv;_c. 

k= 0 


1 


2 


Since  Yn  ->  Ex,  a.e.  as  n — > oo,  the  sequence  (En)  is  bounded  a.e.,  and  the  series 
Sr=o  1°  — l|A'|En_/t|  is  a-e-  absolutely  convergent.  Hence,  Xn  converges  a.e.  as 
n — > oo.  For  a = 1 we  obtain  a standard  Tn  — martingale,  and  for  a = 0 it  is  easy  to 
see  that  the  series  (1.1)  can  not  converge  in  general. 

If  we  embed  Xn  into  a R2— valued  process  ( , A,‘  ),  then 


for  some  matrix  1. 

(Example  2)  Assume  the  J-n— adapted  process  Xn  is  L[  —bounded  and  satisfies 
the  following  equation 

E[Xn+1  \Fn)  = aXn  + (1  - a)E[Xn\Tn-i].  (1.2) 

It  is  easy  to  see  that  E[Xn+k\3~n]  = E[Xn+i\Jcn]  for  all  n and  k , so  if  we  put 

Mn  = E[Xn+i  \Tn]  e Tn,  (1.3) 

then 

E[Mn+1  \7n]  = E[E[  Xn+2\En+1]\En] 

= E[nXn+\  +(1  —cn)E[Xn+ i|JFn]|jFn] 

= qE[ A'n+1  \En)  + (1  - a)E[Xn+i  \EV} 

= E[Xn+l\En] 

= Mn, 

i.e.  the  process  Mn  is  a J-n— martingale.  Let  M ^ be  the  limit  of  Mn  as  n — >■  oo.  From 
(1.2)  and  (1.3)  it  follows  Mn  = aXn  + (1  — q)M„_i,  i.e. 

Mn  — (1  — a)Mn_i 

n 

a 

which  will  then  converge  provided  a^O. 

(Example  3)  Consider  a vector-valued  Ornstein-Uhlenbeck  process 

~tA(v+  f esAd.Bs) 

Jo 


Xt  = e 
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where  Bt  is  a standard  R^— valued  Brownian  motion,  A £ and  v € R^.  Then 

E[e~(t+s)Av \Ft]  = e—Ae~tAv, 

and 

rt+s  ft 

E[  e-(t+s~u)AdBu\Ft}=  / e~(t+s-u]AdBu 
Jo  Jo 

e~(t-u)AdBu. 

If  we  define  a one-parameter  semigroup  {As;  s > 0}  by  As  = e~sA , then  the  process 
Xt  £ Rd  satisfies 

E[Xt+.\Ft]  = AsXt. 

(Example  4)  Consider  a Markov  process  Xt  defined  on  a filtered  probabil- 
ity space  (0.  T,  J-t<  P)  and  taking  values  in  a locally  compact  Hausdorff  space  E. 
Embedding  Xt  Sx ,,  we  can  write  the  equation  of  Markov  property  as 

where  P*  is  the  adjoint  operator  of  Ps.  (We  restrict  / to  Co(£),  the  space  of  all 
continuous  maps  from  E to  R which  vanish  at  infinity.)  Defining  Yt  = Sx,  for  t > 0, 
the  conditional  expectation  can  be  rewritten  in  a convenient  form 

E[Y„, \r,\  = p;y, 


assuming  we  can  give  sense  to  the  above  integral. 


CHAPTER  2 
DISCRETE  CASE 

2.1  Complex-  and  Real- valued  Process 


Proposition  1.  Suppose  Xn  , n = 1,2,...  is  a complex-valued  process  adapted  to 
filtration  J-n  such  that  E[Xn+\\Tn\  = XXn  , where  A £ S'1.  If  Xn  is  bounded  in  L\ 
then 


N 


— } 0 a.s.  as  A — ^ oc 


unless  A = 1. 

Proof.  Dividing  E[Xn+\  \J-n]  = XXn  by  An+1  we  see  that  Xn/Xn  = Mn  is  ^A-martingale, 
and  since  Mn  — XnXn,  it  is  bounded  in  L\.  It  follows  that  Mn  — » a.s.  as  n — > oo. 

Let  Do  C D be  a set  of  probability  one  on  which  Mn  converges.  On  D0  we  can  write 

EL,-Vt  EL,m  EL.m  , 


n 


n 


n 


Let  u>  € D0.  Choose  e > 0 arbitrary.  Then  there  is  an  N £ N such  that  for  all  n > N 
we  have  \Mn[u>)  — Moo(u;)|  < e/3.  Choose  m £ N so  that  m > N and  choose  No  > IV 
so  that 

,EL,A‘M.1<f/:, 


Vo 

For  all  77  > iVo  we  have 

ELm+1  A''  _ ELm  + 1 | < £/3  ELm+1  1 _ £(»  ~ < 


n 


3 n 


Next, 


iMLaA,  _ lM»l  ,1-7" 


< 


2D 

1/ 

vlOO  I 

1 - A 1 “ n\l  -A|' 

Let  / £ N such  that  l > N and  < e/3.  Then  for  any  n > l we  have 


n 


-|  < e/3  + e/3  + e/3  — 


= e 


4 


5 


proving  the  claim. 

Remark  1.  Had  we  assumed 

sup  £’|A',,l|p  < oo 

n 

for  some  p > 1,  we  would  have  obtained  the  convergence 

ELi 


0 


n 


in  Lp  as  well. 


□ 


Lemma  1.  Suppose  Xn  is  a complex-valued  process  such  that  \E[Xn+\ |jFn]  | < a*;,n|An 
for  a matrix  of  positive  real  numbers  (aktn),  k,n  = 1,2, ... . If  Xn  is  square-integrable 
for  every  n 6 N then  RE[Xn+kXn } <y/2ak,nE[\Xn\2]. 

Proof.  Put  Xn  — Rn  + iJ-n-  Then 


|L[/2n+/c|Jrn]|  < ak,n |A'n 


and 


| E{Jn+k  |.7"n]  | A 

so  repeating  the  argument  from  the  Proposition  4 (using  R)  it  follows 

E[Rn+kRn\  < aktnE[\Xn\\Rn\] 


and 


E [Jn+k Jri\  A akn  E [ | A n 1 1 Jn  |] , 
i.e. 

KE[Xn+kXn]  < ak%nE[\Xn\(\Rn\  + \Jn\)] 

Now,  from  the  Cauchy  inequality  we  can  write  \Rn  \ + \Jn\  < \/%J R 2n  + J 2 = V/2|Ara|, 
so 

KE[Xn+kXn]<V2ak,nE[\Xn\2} 


proving  the  claim. 


□ 
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Corollary  1.  If  Xn  is  a complex-valued  process  bounded  in  L2  (i.e.  supn  £[|AE|2]  < 
ooj  and  if  (a,k,n)  Is  a matrix  of  nonnegative  numbers  such  that  supn  YltLi  ak’n  < 00 
and  \E[Xn+k\lFn}\  < ak,n\Xn\  for  all  k,n  € N , k > 0.  then  A't+'n'+A’*  — > 0 a.s.  and 
in  L2  as  n — > 00. 


Corollary  2.  If  Xn  is  a complex-valued  process  bounded  in  If  such  that 
E[Xn+x\IFn]  = XXn  and  |A|  < 1,  then  Al+~~I~A”  — > 0 a.s.  and  in  L 2 as  n -»  00. 

Proposition  2.  Suppose  Xn  is  a square-integrable  real-valued  process  such  that 
E\Xn+\ \Tn\  = pXn,  where  —1  < p < 1.  Let  bn  /*  00  be  an  increasing  sequence 
of  positive  numbers  which  converge  to  +00  as  n — > 00.  If  fc[A|i^  < 00,  then 

f2-  ->  0 in  L2. 

On 

Proof.  Put  Sn  = Xi  + • • • + Xn.  Then 

n 

£(5S  = E £iA») + 2 E 

i=l  i<j 

From  E\Xn+k  \J~ri\  — pkXn  we  obtain 


E[XlXJ\  = p]-'E[X2]  for  1 < j. 


Combining  the  two  equations  it  follows  that 

= E£W]  + 2 


1=1 

n 


1<J 

n — 1 


E E[ Xf]  + 2 E £[-V,2]  E ^ 


i=  1 

n 


i=  1 j=i+l 

n— 1 n—i 


= E ElXf)  + 2 E £(A',2]  E p 

1=1  1=1  k=  1 

n n—  1 


E £iA'?i + 2 **  E 


1 - p 


n — i 


i = l 
n 


= E 1 + 


9 1 - I1 

All. 


i=l 

n—i 


ip 


< 


1=1 


3 + p 

1 - p 


1 - p 


1 - p 

E[A7) 


■E[Xf\ 


E £ra- 


1=1 


(2.1) 


( 


Now,  from  the  Kronecker  lemma  we  have 

Z^EjXf]  ;n 

K 

as  n —¥  oo,  so  from  above  dividing  by  b 2 we  obtain 

£1U:J  l£w; — si — 

as  n — > oo,  proving  the  proposition. 


□ 


Proposition  3.  If  Xn  is  a square-integrable  real-valued  process  such  that 
E[Xn+i  \IFn]  = pXn,  where  0 < p < 1,  then  for  any  e > 0. 


P(  sup  \Sk\  >c)  <e  2T —^2E[Xf]  + e 1~~YEi |X,|] 
\i <k<n  J 1 - P 1 - P flf 


Z-P 


where  Sk  = Xi  4 b Xk  , k = 1, . . . , n. 


Proof  Denote  .4  = {sup1<fc<n  |5fc|  > t}.  Then  .4  is  a disjoint  union  of  sets 


Ak  = {|Si|  < e,...,  |5"*|  > e}  , k-  1,..., 


Write 


Ak 


spa  > E 

k—  1 

n 

= Y E[(Sk  + sn-  Sk)2  lj 


k=l 

n 


= E TKUJ  + Efts,  - St)2])  + 2 E E{Sk(S,  - sun.) 

k=l  k=l 

n n 

> e2  Y P M*)  + 2 J]  T[,S',(.S'„  - Sk)  1.4,] 

k=l  k=  1 

n 

= t2  P(A)  + 2 ^£[Efc(S’n-Sfc)U,]. 


fc=i 

,,n—k 


Now,  from  E[Xn\IFk]  = pn  kXk  for  n > k we  obtain 


i— k 


Efts,  - s4)W  = E'‘‘bY‘  = 


n—k 


p- 


. t=i 


l -p 

1 - [i 


Xk 
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so 


E[Sk{Sn  - Sk)lAk]  = g- — E[Sk XklAk\. 


Combining  the  previous  work  it  follows 


*K]  > <?P(A)  + EfoXtU,]  (1  - p”-‘) 


k=l 


> e2P(A)  + ^ E[Sk-iXklAk]  (1 

1 ^ k= i 


n—k  > 


But,  on  Ayt,  jS'fc-il  < e,  so  > — ei!7[ | JSTyt |] , and  we  have 


> <??(.  4)  - T^-  E(‘  - 

1 LL  k= 1 

For  the  last  step,  observe 

= E + 2 E Elx‘x>\ 


i= 1 


i<j 

2f! 


E £W]  + r5-  E(‘  - 
1 — /./ 
r 1= 1 


(2.3)  and  (2.4)  now  yield 


i-i 


SP(A)  < E e[v.!]  + Y3-  Ed  - /'”")£[*?]  + ff-‘  Ed  - 

^ i=  1 ^ i= 1 


(2.4) 


i = l 
n 


< E *wi  + hE  E + r=V  E w, 

1=1  ^ J=1  A t = l 


(2.5) 


i.e. 


^P(A)  < \±t  E £[At]  + ^ E filial]- 

^ l—l  M ■ 


2/re 


!=1 


Dividing  by  e2  the  result  follows. 


□ 


Remark  2.  For  //  = 0,  Xn  satisfies  E[Xn+\\J-n]  = 0,  and  we  obtain  the  classical 
Kolmogorov  inequality  if  the  sequence  Xn  is  an  i.i.d.,  and  a ” weak ” version  of  a 
maximal  inequality  if  Xn  is  a 'J-n  — martingale  sequence. 
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Proposition  4.  Let  (ajt,„),  k,  n = 1, 2, . . . , be  a matrix  of  positive  numbers  such  that 
siipn  Li  ak,n  < oo.  Le/  .Vn  be  a sequence  of  square-integrable  random  variables  such 
that  supn  E[X2]  < oo  and  \E[Xn+k\Xn]\  < ak,n \Xn\  a-s.  for  all  k,n.  Then 


A i + • • • + A g 
n 


->  0 in  L2. 


Proof.  From  \E[Xn+k\En]\  < ak,n\Xn\  we  have 


and 


E\Xn+k\!F ^ < aktn\Xn\ 
E[Xn+k\Xn]  E Cf/c,n|A n 


Multiplying  first  equation  by  Xf  and  second  equation  by  Xn  we  obtain  after  applying 
the  expectations  operator 


E[ Xn+kX+]  < ak,nE] \Xn\X; 


and 

£[X„+t(-.V-)]  < «t,„£[|.V„|A'']. 

Adding  last  two  equations  yields 

E[Xn+kXn]  < ak<nE[X2n). 

Now,  denote  Sn  = X\  + • • • + Xn.  From  previous  equation  it  follows  that 

n 

= E £iA'?i + 2 E £(**>] 

« = 1 i<j 

= ±E[X?]  + 2 

i=l  1=1  jsi+l 

n n n—i 


= E £iA'.2i  + 2 E E “‘.icra 


i=i 


: 1 \ A=1 


< 1+2  sup 


E <■«)  E 


A / i=l 


Dividing  by  n2  the  result  follows. 


(2.6) 


□ 
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Corollary  3.  Suppose  Xn  is  a sequence  of  square-integrable  random  variables  such 
that  supn  E[X2]  < oo  and  E[Xn+l  \Tn]  — A Xn , where  |A|  < 1.  Then  — — > 0 in  L 2 as 


n oo. 


Proof.  E[Xn+k\Xn]  = \kXn,  so  |£[A'n+Jfc|.7rn]|  - |A*||.Yn|.  Put  ak,n  = |A|T  Then 
Ylk  ak,n  E yrm  f°r  all  ni  and  the  result  follows. 


□ 


Lemma  2.  If  Xn  is  a sequence  of  square-integrable  random  variables  such  that 
\E[Xn+k\IFn]\  < ak,n\Xn\  and  sup nJ2kak,n  < oo,  then 


P ( sup  | AT  + f Xk\  > e ] < e 2 f ~ ~ 

Kl<k<n  J \ log! 


1 + 2 supn  ^ aktn  J ^2  E[Xk]- 

, k J k= 1 

Proof.  From  \E[Xn+k\IFn}\  < ak,n\Xn\  it  follows  E[X{Xf]  < a^tilE[Xf]  for  i < j.  (See 
the  previous  proposition.)  Hence, 

E[  | Ai.  + • • • + Xlk  |2]  < ^1+2  sup  ^2  ak,n\  ^2  E^il\ 

for  any  choice  of  T,  • • • , ik  £ {1, . . . , n}.  Using  the  same  ideas  as  in  Lemma  3 below 
this  implies 

^i<\<n  ^Xl  + " ' + Xk^  ~ 2~)  ( l + 2 SUPn  E ak’n  j it  E\Xk\‘ 

Application  of  the  Chebishev  inequality  yields  the  desired  result.  □ 


Theorem  1.  Suppose  Xn  is  a square-integrable  process  which  is  bounded  in  L2 
(i.e.  supn  E[X2)  < oo),  and  \E[Xn+k \Fn\\  < ak,n\Xn\  where  sup  nY,kak,n  < oo. 
Then 

^ A _» o 


in  L 2 and  almost  surely. 


Proof.  We  already  proved  L 2—  convergence.  A.s.  convergence  follows  directly  from 
previous  lemma  and  Borel-Cantelli  lemma.  □ 
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Remark  3.  If  Xn  satisfies  E[X,Xj]  < aJ_l,lE[X2}  for  i < j and  sup nJfka^,n  < oo, 
then  under  the  assumption  E[X2log2n]  < oo  it  follows  that  X\  + - ■ --\-Xn  converges 
almost  surely. 

Remark  f.  If  Xn  is  a L2  — bounded  sequence  of  square-integrable  random  variables  and 
E[Xn+i\J-n]  = p Xn  for  \p\  < 1.  then  A i-4 " -4  0 in  L2  and  almost  surely. 

2.2  Vector-valued  Process 

Theorem  2.  Let  Xn  G be  a process  such  that  — .4 An  and  p(A)  £ 1. 

If  A is  a symmetric  matrix  and  supn  £’[|Xn|2]  < oo  , then  Al  + „+''Vn  converges  a.s. 
and  in  L2 . 


Proof.  There  is  a diagonal  matrix  D = diag(\\, . . . , \d)  and  orthogonal  matrix  Q 
such  that  QT AQ  = D.  hence,  Yn  = QT Xn  satisfies  E[Yn+i  1^]  = DY , i.e.  in  the 
notation  Yn  = ( V^1 , . . . , Yf ) we  have 

E[Yl+i\Fn]  = , i = l,...,rf. 


Without  loss  of  generality  we  can  assume  p{A)  = Ai  = A-2  = • • • = As  > As+1  > • • • > 
A d for  some  6-  > 1.  If  p(A)  < 1,  then  according  to  Theorem  1 we  have  the  following: 

a;  + • • • + v;; 


0 a.s.  and  in  1/ 


for  all  i = 1,2,...,  d.  Hence, 

Ah  H h X, 


= Q 


>i  + ■ • • + V’ 


o 


= Xs.  Then  Y 


n n 

almost  surely  and  in  L2  as  n -4  oo.  Now,  assume  p(A)  = 1 = Ai 
is  a T2-bounded  martingale  for  i = 1, 2, . . . , s,  so  Vn!  — > Yf^  a.s.  and  in  L2  as  n -4  oo 
for  all  i = 1, . . . , s.  Hence,  * 1 _>  y*  a.s.  and  in  L2  for  all  i = 1,2,...,  s.  For 

n oo 

yr  t i y i 

i > s we  already  proved  1 f n — >■  0 a.s.  and  in  L2  as  n — >■  oo  Consequently, 

X\  + • • ■ + xn 


Q(v 


•i 

oo  ’ 


Y'O 0)J 


almost,  surelv  and  in  L2  as  n -4  oo. 


□ 
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Remark  5.  If  Xn  G <Cd  , E[Xn+\\J-n\  — AXn , and  supn  T^dd2]  < oo,  where  A = 
A' * G Md( C)  such  that  p(A)  < 1,  then  Al+'w'+An  converges  almost  surely  and  in  L2  as 
n —y  oo. 

Theorem  3.  If  Xn  G Cd , E[Xn+1  \7n)  = AXn,  sup„  E[\Xn\ 2]  < oo  w/iere  .4  G Md(C) 
is  a diagonalizable  matrix  such  that  p(A)  < 1,  then  converges  almost  surely 

and  in  L 2 as  n —y  oo. 


Proof.  There  is  a non-singular  matrix  Q such  that  Q~lAQ  = D = (Ai, . . . , A^),  where 
X,  are  eigenvalues  of  A , and  |A;|  < p{A)  < 1 for  all  i = 1,2,...,  cl.  Thus  Yn  = Q~lXn 
satisfies  E[YT\+l  \J-n]  = A ,-Y^  , * = 1, 2, . . . , d.  Hence,  converges  almost  surely 

and  in  L 2 as  n —y  oo  for  all  i = 1,2, . ..,d.  The  convergence  of  Xn  = QYn  follows 
immediately.  □ 

Corollary  4.  If  Xn  G C^,  E[Xn+i\En]  = AXn,  supn  E[\Xn\2]  < oo  where  A G 
Md(C)  is  a diagonalizable  matrix  such  that  p(A)  < 1,  and  1 ^ <r(T), 

then  A— A "■  — > 0 almost  surely  and  in  L 2 as  n —y  oo. 


y'-f  y1 

Proof.  In  the  previous  theorem  the  only  non-trivial  limit  of  1 n"  " 

A,  = 1. 


is  achieved  for 
□ 


Actually,  the  above  results  is  much  more  general.  If  1 ^ cr{A)  and  ||.4||  < 1 
(where  ||.4||  = \J p{ A* A)) . then  A‘+’f+A,i  — y 0 as  n — y oo  almost  surely  and  in  L2 . 
Hence,  we  see  that  the  non-triviality  of  the  limit  is  tightly  related  to  the  eigenspace 
of  1 G cr(A)  (if  such  exists)  and  its  dimension. 

Theorem  4.  Assume  Xn  G G*  satisfies  E[Xn+x  \En]  = AXn  and  supn  < oo. 

Assume  also  that  the  matrix  A satisfies  ||.4||  < 1 and  that  1 ^ cr(A).  Then  A'1+’K+A'n  — > 
0 in  L2. 
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Proof.  Let  M — supn  £7 [ | | 2 ] . Put  Sn  = X\  + • • • + Xn.  Then 

P[|P„|2]  = E[(Xi  + f X„  , AT  + f Xn)) 

= £ £[|A-t|2]  + 2 n'ZEKXi , Xj)] 


k = 1 
n 


j<i 

n 


= £ £[|W|2]  + 2 ft  Y,  E[(A„.tXk  , Xt)] 

k= 1 k=\ 

n 

< nM  + 2 

k=  1 

n 

< nM  + 2 M ^ IM 


12.7) 


k=  1 

where  Ak  = A + A1  + ■ • - + .4fc.  Next,  observe  Ak  = A[I  — Ak){I  — A)~l , since  1 ^ cr(.4). 
Hence,  ||Afc||  < 2|| (I  — .4)-1||,  and  the  previous  reads  after  dividing  with  n 2 

*ii*n  < a + 4M"</--4>'1"  ->  o 

n n n 


as  n — >•  oo  proving  the  claim. 


Theorem  5.  Let  Xn  G Cd  be  a square-integrable,  bounded  in  L2  process.  If 


□ 


E[Xn+l\Fn]  = AXn 


and  ||  A ||  < 1,  then  Sn/n  converges  in  L 2 as  n — > 00. 

Proof.  Denote  P = lim^oo  L J2k=o  ■ Then  P is  a projection,  and  AP  = PA  = P, 
so  E[P. Yn+i|JP„]  = PXn.  Since  ||PA'n||  < ||-V„||,  we  see  that  supn  P[||PAn||2]  < 
supnP[||Xn||2]  < 00,  i.e.  PXn  is  a Z^-bounded  martingale.  Hence,  PXn  — > PX0 0 a.s. 
and  in  L2  as  n -*  00,  and  E[PX oo|£"n]  = PXn. 

Claim:  ^ ->•  PA,  in  Z2. 

n jo  t. 
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Proof. 


YN~l(\  - P V ) 

nil  /—in- U ‘ -*oo/  ||2 


E[{ZXn-PX  op  E-Vn-P-V^ 


IV 

foo, 


/V 


/V 


7V-1 


= ^dE  £[IIA’»  - PA«!I2]  + 2E  £[<a'-  ^ p**»*>  “ PA~»! 


n= 0 
JV-1 


■i<j 

N—  1 N—n  — 1 


(2.8) 


7i{EpniA'»-pA:~ii!)+2E  E £[<A»- PA  oo  ) A:  rv„)]} 


)V2 


n=0 


n=0  /c=l 


71  = 0 fc  = l 


PKPXoo,  *„+*>]  - P[(PX00,Xn)]  + E[\\PX0 


Next,  from  E[Xn+k \Tn]  = AkXn  it  follows  E[(Xn+k,Xn)]  = E[(AkXn,  Xn)].  Further, 
since  .4  = .4  - P + P and  (.4  - P)P  = ,4P  -P=P-P=0=  P(A  — P)  we  have 
Ak  = Xw=o  0)(A  ~ P)lPk~l  = P + (.4  — P)A:,  and  then  we  can  write 


£[pTn+fe,Xn)]  = £[(PAn,  An>]  + £[((A  - P)fcAn,  An)].  (2.9) 


Also, 

E[(PA^,A,l)]  = E[P[(PA00,An)|^n]] 

= E[(E[PX^\En],Xn)\  (2.10) 

= E[(PXn,  An)] 

so  combining  (2.9)  and  (2.10)  we  obtain 

E[(Xn+k,Xn)]  = P[(PAoo,  An)]  + E[((A  - P)kXn,Xn)}. 


(2.8)  now  reads 


£[|| 


Sn 

Jv 


PXn 


< 


k 

N 


„ N-lN-n-l 

+ A E E [pK(-4  - P)k AV,  .V„>]  - £[</>.¥»,  .Yn+t>]  + B[||«um. 

n=0  /c—  1 


(2.11) 
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Next,  observe  1 £ a [A  — P).  Indeed,  since  P is  a projection  on  {;r  : Ax  = x},  we 
have  the  following:  Suppose  (.4  — P)x  = x.  Then  we  can  write  x = Px  + ( / — P)x, 
so  Ax  = 2 Px  + (/  — P)x.  Taking  norm  it  follows  ||At||2  = ||2Pa:  + (I  — P)x\\2  — 
4||P:r||2  + ||(/  — P):r||2  = 3||Pa:||2  + ||:r||2.  Since  ||A||  < 1 this  forces  Px  = 0.  But,  in 
that  case  Ax  — x,  so  Px  = x , i.e.  x = 0. 

After  the  summation 

A / — n— 1 

^ [A  - P)k  = (/  - A - P)~l(A  - P)[(A  - P)N~n  - /] 

k= 1 

(2.11)  reads 

E{\\~  - fWooll2]  < f + P-WU  ~ -4  - P)-'llll-4  - Pll 

JV-lN-n-1  (2.12) 

+ jpY,  E impx^-EUPx^px^)] 

n= 0 k= 1 

because  PXn  ->  PX « implies  P(PAn)  ->  P(PXQO),  i.e.  P(PA'oo)  = PX It  is  now 
readily  verified  that  the  last  term  goes  to  zero  as  7/  — >•  oo,  and  the  claim  follows. 

□ 

Lemma  3.  ( Maximal  inequality ) Let  Xn  £ C(/  be  a square-integrable  process  adapted 
to  the  filtration  LFn  such  that  E[Xn+i  \J-n]  = A Xn . for  some  matrix  A € Md( C)  with 
1 fz  <y{A).  Then  the  folloxuing  inequality  holds: 

Elmtx  \\Xt  + ■ . • + AJ2)  < 2 (l  + 4||(  / - A)-||)  £ £||  A„||2 

and 

2 TV 

rimax,  ||A,  + • • ■ + A'j||  > e]  < f (^f  ) (1  + 4||(/  - A)-*||)  £ E||A'„||2. 

\ ' 71=1 

Proof.  We  follow  Doob’s  ideas  here.  Let  r £ NUO  such  that  2r  < N < 2r+1.  Assume 
also  AT  = 0 for  k > N.  Denote  by  S the  sum  of  all  partial  sums 


Xa+i  + • • ■ Xa+m  , a = pV  , m — 'I1' 
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where  u = 0, 1 , r + 1 ,fi  = 0, 1, , 2r+l  " — 1.  For  each  fixed  u the  sums  of  the 

above  form  have  total  expectation 

j=l  J=1  j= 1 

N 

= ^£!|A'„||!  + 2^£[(A'i,  Aj)] 

n=l  i<j 

N N N-i 

= ££||X„||2  + 2£££[(X„  *«>] 

n=  1 i=l  j=l 

= E £iiA'”ii2 + 2 E E £[(*x  *>) 

n=1  ,=1  ■?=1  (2.13) 

iV  TV  N-n 

= ^E||Xn||2  + 2^£[((^  A^)Xn,  Xn)] 

n=l  n—l  j= 1 

/V  /V 

= £ E||.V„||2  + 2 £ £[((/  - ,1)-‘,1(/  - -4v-n)AE,  -Vn)] 

n=l  n=l 

N 

< J](l  + 4||(/-A)-1||)  £||A„f 

71=  1 

N 

= (l+4||(/-A)-1||)  ££||X„||!. 

71=1 

Hence, 

N 

£[S']<(r  + 2)  (1  + 4 «(/-/()-'  ||)  £ £||A..||2.  (2.14) 

71=1 

Writing  X\  + ■ ■ ■ + Xj  in  the  form  of  partial  sums  of  the  type  JY0+1  -(-•••  + Xa+m,  it 

follows  Xi  -\ + Xj  = Vi  H b Yk  for  some  r + 1 > k > 1,  where  each  Yl  is  of  the 

above  form  and  V)  contains  2rj  members,  r + 1 > rq  > r2  > • • • > r*  > 0.  Further, 
by  Schwartz  inequality  we  have 

k 

||.Yi  + • • • + -Yj||2  = || Ei  + • • • + E'/- 1 1 2 < k ^2  Ill'll2  < (r  + 2)5 
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• so  maxi<j<N\\Xi  + -f  Xj||  < (r  + 2), S',  and  taking  the  expectation  operator  it 
follows  from  (2.14) 

N 

E{maxi<j<u\\X\  + • • • + Ay||2]  < (r  + 2)2  (1+4  || (/  — A)  *11)  ^ £||Xj||2 

71=1 

<(2  + —)  (l  + 4||(/-.4)-1||)  ^E||A'n||2 

(2.15) 

The  other  inequality  follows  immediately  from  the  Chebishev  inequality.  □ 

Theorem  6.  If  Xn  € Cd  is  a square-integrable,  bounded  in  L2  process 
( supn£[|An|2]  < 00)  such  that  E[Xn+\ \J-n\  = A. Vn,  where  ||.4||  < 1 and  1 ^ cr(A). 

« 

Then  :--L±^"t~An  — >•  0 as  n -»  00  almost  surely  and  in  L2. 

Proof.  Previous  lemma,  plus  Borel-Cantelli  plus  Chebishev  inequality.  □ 

For  x = (aq, . . . , xj)  £ we  denote  adJ)  to  be  the  jth  smallest  coordinate  of 
the  vector  x € Rd. 

Proposition  5.  Assume  Xn  € Rd,  ffAT+i |J+„]  = AXn.  Then  for  any  A > 0.  1 < 
p < d,  and  N > 0 the  following  holds  true 

xp  (fS  (T"  + ■ ■ ■ + At’)  > a)  < £[£  (^Wo)01]  + b\  (e  1 

for  any  doubly  stochastic  matrix  A. 

Proof.  For  a fixed  N > 0 

AN~kXk  , k = 0,1,...,  N (2.16) 

is  a martingale  adapted  to  the  filtration  (JFfc).  Next,  observe  the  following:  If  Mn  is 
a J-n—  martingale  taking  values  in  Rrf,  then  each  of  the  processes  Mn\  Mn  + Ml2\ 
...  M'1}  + ■ ■ • + Mn]  = Mln  + • • • + Mi  is  a supermartingale  adapted  to  the  same 
filtration  {T,f)n.  Indeed,  for  the  first  one  we  have 

£[+!•,  psj  < E[A/;+,  \r„\ 


(2.17) 
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for  an  arbitrary  index  i G {1,2, . . . , d}.  (Here  and  in  what  follows  superscript  without 
parentheses  stands  for  a coordinate.)  Taking  minimum  over  i = 1,2 in  the 
previous  equation,  we  arrive  at 


For  the  second  supermartingale  defined  by  the  sum  of  two  lowest  coordinate  elements, 
we  have 

r( 1 ) i ajW  i z 


E[M™ i + M\^\Tn]  < E[M'n+i  + Mi+l \Fn] 


(2.18) 


K + K 


for  an  arbitrary  choice  (i,j)  G {1,2,...,  d}2.  Again,  since  the  left-hand  side  does  not 
depend  on  i,j,  we  obtain 

The  general  case  M,!1*  + Mn + • • • + MnP\  p < d,  is  proved  in  an  analogous  manner. 
Hence,  for  any  p,  1 < p < d, 

<2-w> 

z = l i— 1 

Consider  now  (2.16)  and  (2.19).  It  follows  that 

(.4N-"Xn)(1)  + ---  + (Av-nXn){p) 


is  a J-n—  supermartingale  for  any  p , 1 < p < d.  Applying  fundamental  supermartin- 
gale inequality  we  have  for  any  A > 0 

\P  (jup(.V‘i: ' + •••  + .V'rt)  >x) 

- ((^N_tV,)(  1 H 1-  (Aw-fc.Y,)(p))  > A)  (2.20) 

<£[^(4N.Y„)(,)]  + £[(EA'W')  ] 

i=l  \i=l  / 

where  the  first  inequality  is  obtained  by  the  definition  of  Schur  order.  Namely, 
for  a x G and  A a doubly  stochastic  matrix,  ad1)  < (Ax)^1), . . . , < 

5Z.y=i(^m)(j), . . . , ^(j)  = Ej= i(Ax)(j).  (x  >-  Ax.) 


□ 
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Proposition  6.  Under  the  same  assumptions  as  in  the  previous  proposition  and  as- 
suming Xn  > 0 a.s.  coordinate- wise  for  every  n,  we  have  for  any  N > 0 and  A > 0 

A P (sup  (A'<‘>  + • • • + A'<»>)  > x)  < E{Y  (.4“ 

\n>N  J 

if  A°°  exists.  In  particular,  if  A°°  — > {J,  then 

\P  (sup  (A'<»  + • • ■ + > a)  < t £[]T  A U 

''n~  ' j=  1 

(Here,  J is  the  matrix  with  all  entries  set  to  one.) 

Proof.  We  only  need  to  show  that  (,4nr)^  + ■ • • -f  ( Anxfp ' converges  for  any  x £ 
Observe  the  following:  Since  Ax  -<  x , we  have 

(/Wr)0)  + • • • + ( Anx)ip]  < (An+1x)(1)  + • • • + (.4”+1.t)(p) 

for  any  p , 1 < p < d , and  any  n £ N.  Moreover,  ( Anx )*  = i — 

Y2<i=ix]  f°r  any  * € {1,2,  ...,d}.  Hence,  ^p=1(.4'v+nWv  ) (‘ 1 increasingly  converges 
to  EL.  rw  p1*  almost  surely  as  n — > oo.  The  result  now  follows  from  funda- 
mental supermartingale  inequality  XP(supk>N  Yk  > A)  < E[Yn\  for  a non-negative 
supermartingale  Yn.  □ 

Assume  that  A is  a doubly  stochastic  matrix,  and  EfAT+i  l-TT]  = AXn  , n = 
0,1,2,...,  — 1.  Assume  also  that  Xn  £ R(/  is  non-negative  almost  everywhere 

for  all  n £ N.  Since  A is  doubly  stochastic,  the  process  Yn  = X*  + ■ • • + Xf  is  a 
Tn  — martingale.  Denote 

AP  = max  ({A, A'tf>) 

A'M  = max  ({.V* X* } \ { A'i" } ) 

A'W  = max  ({XJ, ....  X*}  \ {A'W Xf -«}) 
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so  A'!,1  • > X$  > = mini<i<rf Xln.  Since  Xlns  are  non-negative  almost 

everywhere,  we  have  the  following  inequalities 

YlO  < Y1  4 l Yd  < dX [l1 


•vf  + A-W  + •••  + A'W  <A-;  + ...  + .v;  < M (Af>  + ••■  + A'W) 


d 


4"  + A?1  + ■ ■ ■ + Af -«  < 4 + - + A„J  < [^1  (AW  + ■ ■ ■ + 4J-‘)) 

that  can  be  readily  verified.  Now,  let  A > 0 be  arbitrary.  Using  martingale  maximal 
inequality  AP(supn  Yn  > A)  < if[V/vl(supr,v„>A)]  we  have  the  following 


Proposition  7.  Let  E[Xn+1  \Xn\  = AXn  , n = 0,1,...,  N - 1 , and  Xn  > 0 a.s. 
coordinate-wise.  Then  for  any  k , k = 1,2,  ...,d,  we  have  the  following  maximal 
inequality 


\P  (sup  (AW  + ■ ■ ■ + AW)  > a) 


< 


r(i£[(Af  + ---  + Af  n 


Also,  for  any  p , p > 1 , we  have 


X”P  (sup  (AW  + • ■ • + A'W)  > A 
~ fi1£|(A'«  + " ' + A'«  ) 1(.„pn(rt4...+rf'),>j|T)1' 

2.3  Stopping  Time  and  the  Process  E[X„+ 1 \J-n\  = AX T 


(2.21) 


(2.22) 


Suppose  Xn  £ R'Ms  a iFn-adapted  process  satisfying  E[Xn+\  \Xn}  = AXn, 
where  A £ Md( R).  Without  loss  of  generality  we  can  assume  that  Xn  is  defined  as 
a coordinate  process  on  a canonical  space  (R^)00,  i.e.  Xn(uj)  = u;(n),  n = 0, 1,2, . . . . 
Consider  now  an  Wn-adapted  process  Yn  = Xn  — .4n(.Y0  — a),  where  a £ RJ  is  a fixed 
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vector.  For  any  n > 0 we  have 

E[Yn+1  \En]  = E[Xn+1  - An+l(X o - a)|jF„ 


= AAn  - An+1(A0  - a) 
= A(Xn  - An(X o - a)) 


(2.23) 


and  Vo  = Ao  — (Ao  — a)  = a.  If  we  denote  canonical  probability  measure  of  Yn  on 
(R^)00  by  Pa  and  corresponding  expectation  operator  w.r.t.  Pa  by  Ea,  then  under  Pa 
the  coordinate  process  Xn  will  satisfy  Ea[Xn+\\J-n]  = AXn  and  Ao  = a. 

Now,  from  Ea[Xn\To\  — -4”A'0  = Ana  we  have  Ea[Xn]  = ,4na  for  any  a 6 Rd. 
We  know  that  for  any  finite  stopping  time  7’  we  have  Ea[Xn+r\ET]  = AnXj.  Hence, 


AnXT  = EXT[Xn]  (2.24) 

is  true  for  all  n > 0,  and  Ea[Xn+T\XT ] = AnXT  reads  Ea[XnJrT\^T\  - ExT[Xn\, 
a G Rrf,  n > 0,  or,  in  terms  of  shift  operator  07’(u;)(n)  = u{T  + n), 

Ea[Xno6T\TT}  = EXr[Xn].  (2.25) 


Let  now  A:  be  a number  in  N.  If  we  consider  linear  combinations  of  the  type 
Z = A1Ar„i  for  a sequence  in  the  vector  space  generated  by  {Ao,  Aj,  A2, . . . } 
we  see  that  the  formula  can  be  easily  extended  to 


Ea[ZoOT\ET\  = EXt[Z\ 


(2.26) 


Under  certain  mild  conditions,  the  formula  is  true  for  Z in  the  closure  of  the  vector 
space  [A'o,  A1?. . .]. 

Let  ($7,  A,  J-n,  P)  be  a filtered  space  (n  = 0, 1,  2, ... ),  and  An  a process  satis- 
fying E[Xn+\\J-n\  = AXn.  Then  for  any  vector-valued  predictable  process  Hn  G Tn-\  1 
n > 1,  we  can  define  (H  ■ X)n  G Tn  in  the  following  way: 

(77  • A)0  = 0 

n 

( H • A)„  = Y,  HkAn~k(Xk  - AXk-\)  , n > 1 
*:=! 
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where  all  multiplications  are  coordinate-wise.  It  is  easy  to  see  that  the  process  (H  ■ X)n 
also  satisfies  the  same  matrix  form  of  the  conditional  expectation.  Indeed, 

E[(H  ■ X)n+1\Fn]  = E[A(H  • X)n  + Xn+1  - AXn \Tn] 

= A(H  • X)n  + E[Xn+1  - AXn\Fn] 

= A(H  ■ X)n. 

Now,  if  T is  a jTn-stopping  time  and  Hn  — 1 (n<j),  then 

n 

( H ■X)n  = J21(T<n~  l)An~k(Xk  - 

k=l 
T An 

= YJAn~k(Xk-AXk_l) 

k=  1 

= An~l{Xx  - AX0)  + ■ • • + An~TAn(XTAn  - AXTAn-i) 

A n — T An  a atl  v 

— A ^iTAn  — A A0 

also  satisfies  the  same  equation  of  a perturbed  martingale.  Hence,  we  have  the 
following 

Proposition  8.  Suppose  Xn  G Tn  satisfies  E[Xn+l  \hFn]  = AXn  and  let  T be  a Tn- 
st opping  time.  Then  the  stopped  process  Yn  = q(n_7  i+  XjAn  satisfies  the  equation 
E[Yn+ 1 \Tn]  = AYn. 

Proof.  Observe  n — T An  = (n  — T)+.  □ 

Remark  6.  Yn  can  be  written  as 

y _ jxn  if  n < T, 

(An~TXT  if  n > T. 

2.4  Schur  Order  and  The  Perturbed  Martingales 

Recall  that  -<w  is  defined  in  the  following  fashion:  for  a, 6 £ R,  a -<w  b if 
— ]Cf=i  for  p = 1,2, . . . , d,  where  a*1'  < cd2*  < • • • < 

Definition  1.  For  x-i, . . . ,xn  G R(/  we  define  minj<<i<n  X{  - x*  in  the  following  fash- 
ion: 

x*(1)  = maxxi,1* 
k K 


r*(2)  - 


_ / (!)  , (2)\  (1) 
max(3:^  + xk  ) — maxi^ 


x*^  = max(x[.1'  + ■ ■ • + x j^)  — max(i[ + ■ • • + x^)- 
It  is  easy  to  check  x^1)  < x*^  < ■ ■ ■ < x*N)  arid  x*  -<w  Xk , for  all  k,  k = 1, 2, . . . , n. 

Proposition  9.  Let  E\Xn+i\J-n]  — A ■ Xn , .Y„  £ R‘{.  and  ,4  is  a doubly  stochastic 
matrix.  Then  for  any  A £ Rd,  A > 0,  i/ie  following  holds  true: 

I A | P ( min  X,  -T  A)  < E[\Xo\] 

\1  <k<n  J 

where  \X0\  = and  1^1  = Eti  A‘- 

Proof.  Let  A = ( A x , . . . , Xj)  6 RJ  arbitrary  and  positive.  Then  for  any  p , 1 < p < d, 
we  know  that  the  following  holds: 

(A(1)  + • • • + A<p>)  P ( max  x[1]  + • • • + x'p)  > A<x)  + • • ■ + A(p))  < -,E[\X0\]. 

yi  <k<n  J a 

Hence, 

for  all  p , p = 1, 2, . . . , d.  Next,  observe 

1 ^ 2 d 

W>  - A<'>  + A<2>  ~ - \A)  + ...  + \(d) 


SO 


P ^min  Xk  -<  A } < 


E[\Xo\] 


E[\Xo\] 


At1)  -f-  AN)  Ai  + • • • + Ad 


□ 


Remark  7.  The  corresponding  inequality  can  be  obtained  for  —A  £ Kd,  A > 0 as  well. 

Theorem  7.  Suppose  Xn  £ Rd  is  a Tn-adapted  process  such  that  J5[Xn+i|.Fn]  >-  Xn 
a.s.  and  supn  £[||X„||i]  < oo.  Then  Xn  converges  a.s.  in  the  Schur  sense  as  n — > oo. 
In  other  words , xlf  converges  a.s.  for  each  k , k — 1,2, ...  ,d. 


Proof.  For  any  distinct  choice  of  ii,  ?2 
have 
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ik  € and  any  k,  1 < k < d,  we 


i—  1 


i=i 
k 

= Y/ElXn+ 1 \?n 


1=1 


Hence, 


i=l 


x— 1 


So,  by  definition  of  the  Schur  order,  from  the  previous  equation  we  can  write 


£E-vihi^.]>E4i| 


Z — 1 


Z — 1 


(In  the  case  k = cl  we  actually  have  the  equality,  because  obviously  Ylt=i  Xln  = 
Yl  '=i  X$ .)  It  follows  that  for  every  k,  1 < k < d,  the  real- valued  jFn-adapted  process 
Yli=i  xn*  is  a jFn-submartingale  which  is  L1— bounded.  To  see  the  last  claim,  observe 


£[ELi^]|]  < ^Ei=il^»l]  = ^[ll^nlli].  Consequently,  ^Li  converges 
for  every  k,  1 < k < d,  and  so  does  , 1 < k < d. 


a.s. 


□ 


Remark  8.  Varying  assumptions  (e.g.  Lp-bounded,  uniformly  bounded,  etc.)  will 
yield  corresponding  statements  on  Schur  convergence. 

2.5  Counterexamples 

Counterexample  1.  Process  Xn  € Rd  bounded  in  1. 1 and  satisfying  E[Xn+i\lFn]  — 
AXn  for  a doubly  stochastic  matrix  A , and  Xn  does  not  converge  a.s. 

Proof.  Let  Z\  and  Z 2 be  any  two  real-valued  ,Fn-martingales  which  are  bounded  in 
L'  and  converge  to  Z^  and  Zf.  as  n — » oo.  Define  Zn  = (^)  £ two  dimensional 
^-martingale.  Then  Zn  — > (^f ) as  n — » oo,  and  Zn  is  bounded  in  Ll . Put  A = ( ° J). 
Then  A2  = (1°)  = I , so  the  sequence  An,  n = 1,2,...  has  the  form  .4,  /,  ,4,  ...  Define 
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Xn  = AnZn  G Tn  a Revalued  process.  Then  E[Xn+\\Fn\  = E[An+lZn+i  \Tn]  = 
An+l  E[Zn+i  | JT-Vj.]  = .47l+1Zn  = AXn , because  Zn  is  a -martingale.  Furthermore, 
we  have  £[||.<Vn||]  = A[||.4nZn||]  < ||.4n|| £[||Zn||]  < A (K  is  some  positive  constant) 
uniformly  over  n € N,  since  Zn  is  by  assumption  bounded  in  Ll  and  An  is  either  A 
or  I for  all  n.  Hence,  Xn  is  bounded  in  Ll . Next, 

A 2n+l  = -4Z2n+1  — > A Zoo  = 

almost  surely  as  n — » oo,  and 

X211  — fZ2n  -4  Zoo  = 

almost  surely  as  n — > 00.  So,  if  Z\  and  Z2  are  chosen  in  such  a way  that  Z ^ / Z^,, 
we  have  limn  .Y2n+i  ^ limn  X2n  a.s.,  i.e.  Xn  does  not  converge  a.s.  □ 


By  the  same  token,  the  counterexample  can  be  easily  reproduced  for  a process 
Xn  which  is  bounded  in  Lp , 1 < p < 00,  and  Xn  fails  to  converge  a.s.  as  n — Y 00. 


Counterexample  2.  For  any  A = f ^ doubly  stochastic  matrix,  there  is  a pro- 
cess Xn  G R2  , Xn  > 0 a.s.,  bounded  by  a constant  M ( \Xn | < M a.s.)  such  that  Xn 
converges  neither  almost  surely,  nor  in  Lv  (p  > 1).  nor  in  Schur  sense. 

Prooj.  Let  tn  , n = 0,  1, . . . , be  an  i.i.d.  sequence  such  that  E[en]  = 0 and  |en|  < 
x~\p~q\  a.s.  for  all  n.  Define 


Zn  = {p-  q)Zn-i  + e„  , n = 1,2,... 


and 


Z0  — to 


Xn  = 


(l/2  + Zn\ 
\l/2  - Zn) 


, n = 0,1,2. . . 
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Observe  Xn  is  bounded.  Indeed, 

n 

\zn\  = i ^2  tk(/j  - ^ 


n — k I 


k= 0 

/ OG 


< 


< 


v-  Cl 


k\  l-\p-q\ 


, k=0 


1 


i - \p-q\ 


i - I p-  q\ 

= 1/2. 


(2.27) 


Next,  Xn  > 0 a.s.:  Since  \Zn\  < 1/2,  both  1/2  + Zn  and  1/2  — Zn  are  nonnegative. 
Moreover,  0 < Xn  < 1 a.s.  for  all  n.  It  remains  to  show  E[Xn+  i\J-n\  = AXn  for 


E[Xn+1\rn]  = E{ 


( 1/2  + En+1\ 

Vl/2  -Zn+1) 


l^n] 


f 1/2  + (p-q)Zn\ 
Vl/2  -(p-q)ZnJ 

(p  q\  ( 1/2  + zn\ 

Vi  p)  V1/2  ~ Zn) 


AX, 


(2.28) 


Now,  it  is  easy  to  see  that  Xn  cannot  converge  a.s.  Indeed,  the  convergence  would 
imply  the  convergence  of  Zn , and  since  Zn  = (p  — q)Zn-\  + tn  with  en  i.i.d.,  en  would 
converge  almost  surely.  To  see  that  that  the  sequence  Xn  cannot  converge  in  Schur 
sense,  observe  the  following 


Add  _ x[2]  = IX1  - X2\ 


= 2|  Zn 


(2.29) 


so  the  convergence  of  and  Xl^  would  imply  the  convergence  of  \Zn\  . By  the 
same  argument  it  is  easy  to  see  that  the  convergence  cannot  hold  in  Lv  as  well.  □ 


CHAPTER  3 
CONTINUOUS  CASE 


Let  Xt  be  a Markov  process  on  a filtered  space  (fl,  J-t.  P)  taking  values  in  some 
locally  compact  metric  space  E.  If  we  denote  Co{E)  the  family  of  continuous  real  func- 
tions defined  on  E and  vanishing  at  infinity,  then  we  know  E[f(Xt)\J-a]  = Pt-sf{Xs) 
(for  the  corresponding  semigroup  Pt  and  filtration  JF()  for  all  / 6 Co{E)  and  t > s. 
Now,  consider  Xt  as  a measure-valued  process  taking  values  in  M(E),  the  fam- 
ily of  all  regular  measures  on  E with  finite  variation.  With  natural  identifica- 
tion of  Xt  and  8x,  € M(E)  we  can  rewrite  the  basic  equation  of  Markov  pro- 
cess as  E[8xt(f)\Xs]  = 8x,(Pt-sf)  for  every  / € Cq{E).  For  a bounded  opera- 
tor Pt  : Cq(E)  — ► C0{E)  denote  P*  its  adjoint  P*  : C0(E )*  — > C0(E)*.  Then 
(ptt*)(f)  = P(Ptf)  for  all  n € M(E).  In  particular,  (P?-,5x.){f)  = 5Xs{Pt-sf) 
and  the  basic  equation  can  again  be  rewritten  as 

E[h,(f) \F.)  = (P^SxXf) 

for  all  / € Co(E).  With  ) , = Sx,  the  equation  has  the  form  of 

E[Yt\Xs\  = p;_sy3 

if  the  integral  is  suitably  defined.  Note  that  the  hint  of  using  Bochner  integral  fails 
immediately  because  our  functions  Yt  will  not  even  be  strongly  measurable,  and, 
indeed,  not  even  P-almost  separably  valued:  for  any  a:,  x'  6 E , x / x\  ||^r  — Jx/||  = 
sup||y||oo<1  \f{x)  — /(.'r,)|  > 1,  so  if  Xt  takes  uncountably  many  values  with  positive 
probability,  then  the  range  of  Yt  = 8xt  is  not  separable  in  M(E).  To  develop  a 
general  theory  of  processes  of  the  form  E[Xt\Ta\  — At-sXs  we  need  to  resort  to 
different  techniques.  One  reasonable  approach  can  be  accomplished  if  we  restrict 
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ourselves  to  processes  taking  values  in  dual  Banach  spaces,  with  the  predual  being 
separable.  For  example,  if  E is  a separable  metric  space,  then  M(E)  = Co(E)*  is  one 
such  example.  Before  we  proceed  with  the  treatment  of  the  one-dimensional  case,  let 
us  consider  the  following  theorem  as  a motivation. 

Theorem  8.  (Uniformly  Feller  process  as  a perturbed  martingale)  Let  Xt  be  a Feller 
process  with  uniformly  continuous  semigroup  P,  acting  on  Cq(E),  where  E is  locally 
compact  second- countable  Hausdorff  space.  Then  Xt  defines  measure-valued  process 
Yt  = Sxt  taking  values  in  M(E)  such  that  £^[^1^]  = Pf_sYs  , s < t,  where  P*  is  a 
uniformly  continuous  adjoint  semigroup  of  Pt.  (The  integral  is  taken  in  wk* -sense.) 

Proof.  Yt  is  defined  on  the  same  probability  space  (Q,lF,  P)  and  for  all  t > 0 we 
have  < Yt,  f > = < Sxt , / >=  &xt{f)  = f{Xt).  This  function  is  clearly  measurable  for 
any  / E C0(E),  and  from  E[\  < Yt,f  > |]  = / \f(Xt)\dP  < ||/||oo,  we  see  that  Yt 
is  weakly  P-integrable  for  all  t > 0.  P(_SYS  is  also  weakly  P-integrable  for  all  s and 
t.  By  definition  of  conditional  expectation,  it  follows  that  Yt  has  a weak  conditional 
expectation  for  every  s <t,  and  £[Vt |£s]  = Pf_sYs.  Since  Cq(E)  is  separable,  we  see 
that  Yt  actually  has  a conditional  expectation  w.r.t.  kFs,  and  E[Y't\J-s]  = Pf_sYs.  Next, 
from  PtCo  C Co  it  follows  that  P*  : M(E)  — > M(E)  is  well  defined.  Moreover,  Pj  = 
/*  = /,  and  (Pt*p;)(p)(f)  = p;(P»(/)  = (PS»(P/)  = n(P.{Ptf))  = /i(JW)  = 
(Pt*+Sp)(f),  so  PfPf  = Pf+s-  If  t \ 0 then  II Pfp  - /r||  = supi^y^^j  |(Pt>  - p){f) \ = 
suP||/||oo<i  \p{Ptf-f)\  < ||HIII^/-/lloo  ->  o since  P,  is  uniformly  Feller.  Hence,  Pt* 
is  uniformly  continuous  semigroup  on  M(E).  □ 

3.1  One-Dimensional  Perturbed  Martingale 

We  have  seen  earlier  that  E[Xt+s\tFt]  = eAs.Y(  can  be  interpreted  in  an  operator 
sense  in  the  following  way:  if  we  define  Ps  : Ll  (Ll)  — » Ll(Ll)  to  be  the  multiplication 
operator  Psx  = eXsx  , for  all  x E then  we  can  write  E[Xt+s\J-t]  = PsXt.  The 

question  which  arises  naturally  is  the  following:  Suppose  there  is  a family  of  linear 


29 


operators  (Pa,s  > 0)  acting  on  Ll  such  that  process  Xt  satisfies  E[Xt+s\Pt]  = PaXt  , 
s,t  >0.  What  can  we  say  about  Xt  and  the  family  of  transformations  Ps?  Obviously, 
since  E[Xt+a\J-t}  € Pt,  we  must  have  PsLl(Pt)  C Ll{Pt)  for  all  t,s  > 0.  Furthermore 
E[Pt+Sl+si\Pt]  = P s i+s2Pt-  On  the  other  hand, 


£’[A/+S]+S2|^r/] 


E[E[Xt+,l+n  \P,+ai]\Pt] 
E[p«xl+.l\rt) 


(3.1) 


= PS2E[Xt+Sl\P] 

= PS2PSlXt 

if  we  suppose  that  Ps  commutes  with  E[-\Pt],  Hence,  (Ps,s  > 0)  is  a semigroup  on 
{Xt,t  > 0}.  The  converse  is  also  easily  verified:  if  Ps  restricted  on  {Xt,t  > 0}  is  a 
semigroup,  we  have 


E[PuXt+s \PS\  = E[E{>  i-U+t  + S \Pt+s\PS] 

= E[Xu+t+s\Ps\ 

= Pu+tXs  (3.2) 

= PuPtXs 


= PuE[Xt+s\Ps] 

i.e.  Ps  and  E{- \Pt\  commute  for  every  s,t  > 0. 

Consider  the  discrete  case.  It  suffices  to  assume 


E[Xn+i\Pn\  = PXn  , n > 0 

where  P is  a bounded  operator  on  Ll(Q)  and  P(Pn)  C pn  , n > 0.  It  immediately 
follows  E[Xm+n\Pn]  = PmXn  , m,n  > 0 , and  then  E[Xm+n\  = E[PmXn\.  In  par- 
ticular, E[Xm]  = E[PmX o].  Assume  now  that  (Hn,n  > 0)  is  a Pn  — predictable  and 
bounded  process.  Define 

( (H-X)0  = 0 

] (H-X)n  = 'jr,Hm{Xm-PXm-1) 


(3.3) 
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Then  ( H • A')n  € Tn  is  integrable,  and 


E[(H  • X)n+1\Fn]  = E[(H  • X)n  + H1l+l(Xn+i  - PXn)\Tn] 
= (H  • X)n  + Hn+1E[Xn+i  — P An  n] 


= (H-  X)n  + Hn+1(E[Xn+1  \Tn]  - PXn) 


(3.4) 


= {H-X)n 


Hence,  (H  ■ X)n  is  Tn— martingale.  Now,  let  T be  a bounded  stopping  time. 
Then  Hn  = l(T=n-i)  £ Tn- 1,  « > 1,  and  we  have  (H  ■ X)n  = J2m=i  l(T=m-i){Xm  ~ 
PA'm_i)  = Xt+i  — PXj  , if  T < n.  Taking  expectation  we  get  E[Xj+ 1]  = E[PXj\. 
For  k > 0 we  can  define  the  following  process 

r <//  a- )i*>  = o 

| (//  ■ X)W  = J2  - PXm-t ) [i':" 

v m=  1 

It  is  readily  verified  that  ( H ■ X)^  € Tn  is  a J~ n — martingale,  because  Pk  com- 
mutes with  E[- \Tn}-  If  we  substitute  Hn  — l(r=n-i)  € Tn-\,  then  it  follows  that 
E[PkXr+i]  = E[Pk+l Xt]  , for  all  k > 0.  Hence,  for  any  bounded  stopping  time  T 
we  can  write 


E[XT+n } = E[P  Aj+n-i] 


= E[P2XT+n.2] 


(3.6) 


= E[Pn  At], 

Note  that  in  general  we  can  not  expect  EfA'r+s]  = E[PsXt]  to  hold  for  two  bounded 
stopping  times  S and  T because  it  is  easy  to  see  that  for  any  bounded  by  n stopping 
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time  T the  following  holds. 

E[XT+n\Fn]  = E[Y/X  k+n  1 (T=k)\Fn] 
k 

= ^ l(T=k)E\Xlt+n\Jrn] 
k 

= £ Ur=*)PkX„ 

k 

= PTX„ 


(3.7) 


so  E[Xr+n  \Xn\  = P1  xn.  We  cannot  expect  this  to  hold  for  any  Z+- valued  T because 
the  left-hand  side  is  J-n— measurable,  and  in  general  there  is  no  reason  why  PTXn 
would  be  such.  (Though,  we  know  PkXn  G Xn.) 

We  have  already  observed  that  under  the  assumption  of  right-continuity  of 
a(s),  s > 0 , it  follows  that  a(s)  = eAs  for  some  real  number  A.  We  have  also  seen 
that  the  defining  property  of  process  Xt  , namely  E\Xt+a\T^  = a(s)Xt  + b(s)  , entails 
b(t  + s)  — b(t)a(s)  -f  6(s),  t,s  > 0.  Now,  we  will  look  at  this  equation  more  closely. 
Interchanging  the  roles  of  t and  s , we  have  b(t  + s)  = b(s)a(t)  -f  6(f)  , so  combining 
the  two  we  obtain 


(1) 


b(s)a(t)  + b(t)  = b(t)a(s)  + b(s) 


b(s)(a(t)  - 1)  = b(t)(a(s)  - 1) 

If  we  assume  right  continuity  of  a,  then  it  follows  a(s)  = eAs.  Thus,  of  if  A ^ 0,  (1) 
implies 

6(s)(eAf  — 1)  = b(t)(eXs  — 1)  , t,s  > 0, 


i.e. 


(2) 


b(s) 

e\s  _ 


b{t) 

t 


t,s>  0. 


Since  the  left-hand  side  of  (2)  does  not  depend  on  t , we  must  have 
real  constant,  for  all  s > 0.  In  other  words, 


= A , a 


(3)  b(s)  = K(eXs  - 1)  , s > 0 


Now  we  have  the  full  description  of  the  process  Xt  and  we  can  state 


Theorem  9.  Suppose  Xt , t > 0,  is  a Xt  — adapted  real-values  process  on  filtered  space 
(fl,  X,  J-tl  P)  such  that  E[Xt+s\lFt}  = a(s)Xt-\-b(s)  for  some  right- continuous  function 
a and  a measurable  function  b.  Then  a(t)  = eXt  and  b(t ) = A'(e  A<  — 1),  / > 0,  for 
some  real  constants  A and  K,  i.e.  A[A',+S|.A/]  = eXsXt  + A(eAs  — 1). 

In  an  analogy  with  discrete  processes,  it  is  easily  demonstrated  that  Xt  can  be 
linearly  transformed  into  a martingale  adapted  to  the  same  filtration  as  Xt.  Indeed, 
put  V,  = 7 tXt  + A(,  t > 0.  Then  Yt  6 Xt  and  imposing  E[Yl+s\Xt]  = Yt  implies 

E[~lt+sXt+s  + A(+s|JF j]  = 7, A,  Xt 

7<+s  A[A/+s|JF,]  + A/+s  = 7(  Ab  + A, 

7 i+s(e'XsAh  + A (eAs  — 1))  + 7(+5  = ~ftXt  + A, 
so 

f 7 t+s£  = 7 1 

(4)  { 

[ ~ft+sE  (eAs  — 1)  + A(+s  = A/ 

If  we  put  70  = I,  then  7 s = e_As  and  if  we  put  A0  = 0,  then  Xs  = — e_AsA'(eAs  — 1)  = 
A(e_As  — 1),  which  is  easily  seen  by  letting  t — 0 in  (4).  Hence, 

Yt  — e MXt  + A (e  xt  — 1)  , t > 0. 

It  is  readily  verified  that  Yt  is  a ^—martingale.  Some  questions  about  the  process 
X t can  thus  be  reduced  to  the  corresponding  questions  about  the  process  Yt.  For 
example,  if  a(t)  is  right-continuous,  then  Xt  admits  to  a right-continuous  version, 
etc. 

3.2  General  Perturbed  Martingale 

We  now  return  to  the  treatment  of  general  processes  A[A',+s|jF(]  = AsXt.  In  the 
following  we  shall  assume  at  least  the  following:  Xt  is  a Tt  — adapted  process  defined 
on  a filtered  space  (f l,lFt,P)  with  A— complete  filtration  (JA);  Xt  takes  values  in  a 
dual  Banach  space  E = (A,)*  where  A,  is  assumed  to  be  separable;  and  {At\  t > 0}  is 


a w k*  — continuous  semigroup  of  operators  acting  on  space  E.  For  a pairing  between 
x G E and  x » G E * we  shall  write  < x,  x*  > or  x(x„).  The  map  fl  3 u;  i— > ||Ah(u;)||  G R 
is  assumed  to  be  in  Ll(Cl,  P ). 

Definition  2.  ,4  function  T : A x E*  R+  defined  on  a filtered  space  (If  Ft)  is 
called  a Ft— stopping  time  ifT(-,x)  is  a standard  Ft— stopping  time  for  every  x G E*. 

Definition  3.  For  a process  X : [0,oo)  x f 1 £ (simply  X)  defined  on  a filtered 

space  (if  Ft)  and  a Ft  — stopping  time  T,  we  define  Xj  on  {T  < oo}  by 

< XT(lo),X  > = < Xt(u,x){w),X  > 

for  all  x G £*. 

Definition  4.  For  t > 0,  let  £>([0,t])  be  the  Borel  a — algebra  on  [0,f].  A process 
X : [0,oo)  x H E (simply  X)  is  progressively  measurable  or  simply  progressive 
with  respect  to  the  filtration  (Ft)  if  for  every  t > 0 and  every  x G E,  the  map 

(s,cu)  !-><  Xs(w),x  > 

from  [0,t]  x ft  into  E is  B([0,t])  ® Ft~ measurable. 

The  following  two  propositions  are  immediate  consequence  of  the  standard 
theorem  for  real-valued  processes. 

Proposition  10.  An  adapted  process  with  right  or  left  continuous  paths  is  progres- 
sively measurable. 

Proposition  11.  If  X is  progressively  measurable  and  T is  a stopping  time  with 
respect  to  the  same  filtration  (Ft),  then  Xj  is  Ft— measurable  on  the  set  {T  < oo). 

Theorem  10.  Let  E[Xt+s\Ft]  = AsXt.  In  addition  to  assumptions  stated  above,  if 
Xt  is  wk*  — right  — continuous  and  the  semigroup  {Ap,t  > 0}  is  equi- continuous,  then 
the  process  {A(i_T)+xt„T\t  > 0}  is  a perturbed  Ft— martingale  (i.e.  it  satisfies  the 


same  equation  E[Xt+,\Tt\  = AsXt  ) with  respect  to  the  same  filtration  Tt  and  the 
same  semigroup  At  for  any  Tt  — stopping  time  T. 

Proof.  {A(t_'r)+Xi^T  G Tt)  Let  Tn  be  a decreasing  sequence  of  finitely  valued  stopping 
times  such  that  Tn  \ T.  We  first  show  that  /l((-r„)+  XtArn  G Tt  for  every  n and  every 
t > 0.  Indeed,  if  we  denote  by  Tf  kn  distinct  values  of  Tn  we  can  write 

kn 

A(t-Tn)+  XtATn  = V A(t_T*)+  XtATkl(Tn=T>:)- 

k=\ 

Case  1 (Tf  < t): 

Each  such  term  A(t-T,\)+  Xt^rfX  (T„=Th)  m the  above  equation  is  in  the  a — 
algebra  Tjk  C . 

Case  2 ( T ’*  > t): 

C ollecting  all  terms  A((_yk)+  AjAr*l(xn=T*)  — Xt\ (r„=T*)  we  obtain  Xt\ (Tn>t)  = 
Xt ( 1 — l(r„</))  G Tt  because  each  Tn  is  an  Tt  — stopping  time. 

Now,  if  n goes  to  infinity  (/  - Tn)+  /•  (t  - T)+  by  continuity  of  x i-> 
max(O.x),  and  t A Tn  \ t A T by  continuity  of  the  wedge  map.  It  remains  to 
show  {A(t-Tn)+  Xt/\Tn)(x*)  — > (A(t-T)+XtAT){x*)  for  all  x,  G E,  as  n — > oo.  On  E»  we 
can  write 

\A(t-Tn)+TtATn  ~ ^(1-T)+^C<At| 

= \A(t-T„)+XIAT„  - •4((_r„)+ AhAr  + .4(/_r„)+.V,AT  - A{t-r)+  AW  I 

= l-4p-rn)+(-A(AT„  - Ah  at)  + [A(t_Tn)+  - .4(,_T)+  )AW| 
so  for  an  x»  G E» 

l(-4((-r„)+AhATn  - -4((_T)+Ah)AT)(^«)l 

< l(-4(<-Tn)+(AhAT„  - AhAr))(z.)| 

+ K(^4(<-t„)+  - •4(f_T)+)AhAT)(j.)|- 

By  wk*— continuity  of  the  semigroup  At  it  follows  that  the  second  term  converges  to 
zero  as  n — > oo.  By  the  equi-continuity  of  At  we  have  for  the  first  term 


l(A(t_T„)+(AhAT„  - AW))(x,)l  < q{XtATn  - XtA t) 
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for  some  continuous  semi-norm  q on  E.  Since  X is  by  assumption  wk* —right  — continuous, 
the  first  term  converges  to  zero  as  well  proving  A(t-T)+  XtAT  € J~t-  It  remains  to  show 

£[,4p+s_T)+AVs)Ar|^]  = -^s^(t-T)+XtAT- 

If  T is  finitely-valued  taking  values  in  {t i, . . . An}  this  follows  by  induction.  Indeed, 
using  index  i for  ti  we  have 

E[A(i+i-T)+X(i+i)AT\Fi]  = E[Ai+i-jXTl(T<i)\Xi\  + ^[^t+1l(T>i+l)l^r«'] 

= AiAi-TXrl(T<i)  + ^4i^!'l(T>t+i) 

= •4i^4(!-t)+^»at 

and  for  k > 1 

E[A(i+k-T)+X(t+k'l^T\J7i]  = E[E[A(i+k^T)+X(i+k)AT\^i+k-i]\^i\ 

= E[AiA(i+k_i_T)+Xi+k-iAT\Xi] 

— AiAk-iA(i_T)+XiAT 
= A^  .4(i_7)+.Y,Ar- 

We  show  next  E[A(tk+1-T)+Xtk+lAT\Eu } = Atk+1-UA(U-T)+XUAT  for  < u < tk+i- 
E[A(tkJtY-T)+XtkJrl^T\X u]  = E[Atk+l-TXTl(T<tk)\Eu} 

+ E[Xtk+il(T>tk+1) \Fu] 

= Atk+1-TXTl  T<tk  + ^i*+i-u^ul(T>tfc+1) 

= Atk+1-u[Au-Tl(T<tk)  + l(T>tfc+1)]^uAT 
= Atk+1-UA(U_T)+XUAT 


36 


Finally,  to  show  E[A(u.t)+XuaT \Ftk]  = Au-tk  A(<fc_T)+XtfcAT  for  tk<u<  tk+ 1 we  can 
write 

£[^(u-r)+ Au/vxl^J  = 

+ ^[^ul(T><Jt+I)|^it] 

= Au_ifc£[y4tfc_TArrl(T<<fc)|^rtJ 
+ Au-tkXtk  l(r>tk+1) 

= ^4u-tfc^*l(T=<fc)  + Au_tfcXtfcl(T>ifc+1) 

+ Au-tkE[Atk-TXTl(T<tk.l)\^t^ 

= Ah*l(T><*) 

+ .4u_4.4t/c_T.VTl(T<ifc-i) 

= ^u-tfc^t*Arl(r>tt) 

+ A„_7’A"t(;ATl(r<4_1) 

= (Au-tkl(T>tk)  + ,4u_Tl(T<tfc_1))Ar4AT 
= Au_tfc(l(T>tfc)  + A(k_Tl(T<4-i))^4AT 

= Au_tfcA(4_r)+AhfcAr- 

Hence,  the  equality  E[A{t+s_T)+X{t+s)AT\Xt]  = AsA(t_T)+XtAT  holds  true  for  any 
finite  stopping  time  T.  Using  limiting  arguments  from  the  first  part  of  the  proof  the 
general  case  follows  for  an  arbitrary  Tt~ stopping  time  T.  □ 

Definition  5.  li  e shall  call  A 7 = .4(,  -T)+XtATi  Xt  stopped  at  time  T.  So,  the  pre- 
vious theorem  can  be  restated  saying  that  a stopped  perturbed  Et~  martingale  is  also 
a perturbed  Tt  — martingale. 

Corollary  5.  (Optional  Stopping  Theorem)  If  {Xt;t  > 0}  is  a real-valued  right- 
continuous  martingale,  then  E[Xt\Ts]  — Xs  for  any  two  bounded  stopping  times  S 
and  T such  that  S < T. 
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Proof.  From  E[X^s+t)AT\lEi]  — XjM  it  follows  by  letting  s — > oc 

E[Xt\Ti)  = Xjm- 

Assume  first  that  S has  a finite  range,  S € {si, . . . , s„}.  Then  on  {5'  = sk}  and 
letting  t = Sk  in  the  above  we  have 

E[XTl(s=Sk)\Xsk]  = XSkl{S=Sk) 

so  that  E[XTl(s=sk)]  = £[A^l(S=S;t)]  for  all  sk.  Hence,  E[XT\fFs]  = Xs  if  S is 
finitely-valued.  Next,  to  prove  the  equality  for  an  arbitrary  S < T,  observe  that  Xt 
is  tFf  — martingale  as  well  since  it  is  right-continuous.  Choosing  the  sequence  Sn  of 
finitely-valued  stopping  times  such  that  Sn  \ S proves  the  claim.  □ 

We  shall  see  next  that  under  certain  assumptions  we  can  dispose  with  the 
requirement  for  equi-continuity  of  the  semigroup  {At;t  > 0}. 

Proposition  12.  Suppose  Xt  is  a perturbed  fFt  — martingale  with  the  associated  semi- 
group {At\t  > 0}.  Assume  that  there  exists  a sequence  X}"*  , n = 1,2,...,  of  per- 
turbed T\  — martingales  with  equi- continuous  semigroups  {A^'.t  >0}  , n = 1 . 2 

such  that  < A^X\n\x  > is  uniformly  in  s and  t bounded  by  an  integrable  random 
variable  for  each  x 6 if*,  and  A^ X\n^  — > AsXt  ( wk *)  a.e.  Then  E[Xf+s  \fFt]  = AsXj . 

Proof.  If  we  denote  Xj'n  = X^Tl  then  we  know  that  for  each  n the  equation 

E[Xj_fl\J-t]  = A(sn)Xjfn  holds  true.  Taking  limit  n — > oo  the  claim  follows.  □ 

Consider  next  the  case  of  the  standard  Brownian  motion  on  real  line  with 
transition  density  pt(x,y)  = ^=e~ , x,y  G R.  We  shall  show  how  to  apply  the 
previous  proposition  in  this  case. 

Proposition  13.  Let  {Bt’,t  > 0}  be  a standard  Brownian  motion  on  R with  semi- 
group 

Ptf{x)  = -j=  J e-L^f(y)dy 
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for  all  f E C0(R).  Then  there  is  a sequence  {Pj'n'>;  n = 1,2, ...  } of  semigroups  acting 
on  C0(R)  such  that  / — > Ptf  weakly  for  all  f E C’o(R),  and  each  {(P“)*;  t > 0} 
is  equi- continuous. 

Proof.  For  Bt , t > 0,  denote  by 

Pt(x,y)  = Pt(x,y)  + Pt(x,  -y)  , x,y  > 0 


the  transition  density  of  reflected  at  zero  Brownian  motion  \Bt\.  Consider  now  Brow- 
nian motion  reflected  at  —a  and  a for  a positive  and  finite  real  number.  Its  density 
functional  is  given  by 

-f  oo 

Pt(x,  y)  = ^ Pt(x  + ai  y + a + 4na)  , —a<x<a,  —a<y<a 

n=— oo 

([1].)  Denote  by  {Pf\t  > 0}  the  associated  semi-group 

+oo 

ptafix)=  / Pt(x  + a,y  + a + 4na)f(y)dy 

n=-oo  J\y\<a 

acting  on  Co(R).  Then 


+oo 


P,“/(,r)=  V -= 
, \/2nt 


( x — y — 4na ) 


2t  -|-  6 


(ff  + 2/-Hrcq  + 2a) 


|y|<“ 


)f(y)dy 


i 


71^0  v w7rr  J\v\<* 


(z-y-4jia)2  (i-+y-r4na+2a)2 

(e  2<  + e 21  )f{y)dy 


+ 


1 


(x-y) 


(x  + y + 2a)2 


\f2nt 


\y\<a 


(e  21  + e 2<  )f(y)dy. 


We  will  show  that  Pf f ->  Ptf  (weakly)  as  a — > oo.  First,  we  show  that  terms  with 
u/  0 go  to  zero  as  a — »•  oo.  Indeed, 


^ \/2^  i|y|<a 


(e 


( x — y — Ana )* 


{x-\-y-\-4na-\-2a)^ 


+ e 2t  )/(y)dy| 


< 


E 

n^O 


\/27rt 


_ (a:— 4na)2  _ (x+y+4na+2a)2 

e 2t  -f-  e 2t 


)l  f(y)\dy 
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and  for  the  individual  terms  in  the  summation  we  have  for  lad  < a 


J\y\<a 


^ \f[y)\dy  < 


< 


l 

\Z'2nt 


< 


= /' 

2nt  J\y\<a 


y/2nt 

1 

\/‘2nt 


ls/|<u 

f 

f 

M<« 


U-.v)2 

8|n|a|x-.vl  16n2o2 

2 1 

Cl 

<L» 

(N 

Qj 

(x—y)2 

8n^a|:r  — y|  — 16n^ 

2 1 

e 21 

(I-!/)2 

8n^a(  |a: | -f- a ) — 16n^  a2 

2t 

e 2t 

(*-y>2 

-8n2a2+8n2a|x|  . 

I f(y)\dy 


\y\<a 

— 8n2a(a  — ix|) 

e 2t 


\y\<a 


( x — y m 

e-  - |/(y)|dy 


1 — 8 n2  g(g  — |:r| 

< e 2t 

y/2n  t 

— 8n2o(g-|x|) 

< e 2‘ 


/ 


e i£^L|/(y)My 


By  the  same  token  we  obtain 


(3.8) 


lx  — y — 4na  + 2a)2  — 8n2  a(a  — |:r|) 

e 21  \f{y)\dy  < Le  2<  im|00 


\Z2irt  J | y | < o 

for  some  L > 0.  Combining  (3.8)  and  (3.9)  we  obtain 

( x — y — 4na)^  _ ( J-f  y + 4na-f  2a)^ 

TmL.}e'  ' ' 

n^O 


V -L_  f 

\/2l Tt  J\y\<a 


2<  + e" 


I 7 i Ci  -T*  £ CI  I 

21  )/(y)dy| 


<(i  + r)ll/ll«E 

71^0 

<(i  + i)ii/iuEe 

n^O 


8»r  a(  a — |ar  | ) 

e“  2t 


8|n|a(a-|3r|) 
2 1 


8na(q  — |j 
“ 2 £ 


2(1  + £)II/IUX> 

71=1 

2(1  + DH/lloo  8a(fl  — |.r|) 

e 2i  — 1 


(3.10) 


->•  0 
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as  a — > oo.  For  the  n = 0 term  in  Pff(x)  we  have 


/ 

py\<a 


p+(x  + a,y  + a)f(y)dy 


ls/|<“ 


(e 


+ e' 


( j+jZ+ia)^ 


)f{y)dy 


+ 


\/‘2nt 

1 


|j/|<a 


e~  21  f{y)dy 


’3-11) 


\/27r7  J |y|<a 

The  second  term  goes  to  zero  as  a — > oo  since 


(i  + j/  + 2o)^ 

e-^r^f(y)dy. 


1 


_ (J+.v  + 2a)2 

f 21 


l/(y)l<*y  < 


/(y  - x - 2a)\dy 


and  f(x)  ->  0 as  x — > ±oo.  The  first  term  converges  to  Ptf(x).  It  remains  to  show 
that  fi(Pff)  -4  y{Ptf)  for  all  y € M(R)  = Co(R)*.  Since  each  Pf  is  a transition 
semigroup  for  a homogeneous  Markov  process, 


SUP  \Ptf(x)\  < j j y ||  oo  < OO, 

X 

and  the  claim  follows  by  the  Lebesgue  Dominated  Convergence  Theorem.  □ 

If  we  now  denote  by  B\p  reflected  Brownian  motion  at  — n and  n (n  = 
1,2,...),  then  for  each  / 6 Co(R)  we  have  by  identifying  Bt  and  Sb, 

= (pW/,(B(»l) 

which  converges  to  ( Psf)(Bt ) as  n — >•  oo,  because  for  almost  all  paths  we  have 
BlP  = Fh  eventually.  In  addition  to  this,  |((Pi"^)*B|n*)(/)|  < ||/||0o||(Fj"*)*j9(*,1,||  < 

ll/lloo  < OO. 

We  know  that  L2— bounded  martingales  have  finite  second  variation.  For 
perturbed  martingales  a similar  result  holds  true.  We  have  the  following. 

Proposition  14.  Let  Xt  be  a -perturbed,  martingale  such  that  each  At  is 
wk*  — continuous  with  strongly  continuous  semigroup  > 0}  and  pregenerator 

M».  We  shall  write  A for  A(x){x*)  = x(A*x*).  Denote  by  0 = to  < t\  < ■ • ■ < tn  = t 
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a partition  of[0,t]  with  A tt  = tt  — t{-i.  If  sup0<KT  £[||AL||2]  < oo  for  each  T > 0, 
then 


lim  y-'  E[\Xt 

max\ Att  |— >-0  * ^ 


Xu_x  I2]  = E[\Xt\2]  - E[\X0\2]  - 2 / E[AXU  • Xu)du 


i—  1 


on  D(A *)  for  each  t > 0. 


Proof.  For  any  s,t  > 0 we  can  write 

E[ \Xt+s(x)  - Xt(x)\2\Ft]  = E[\Xt+s(x)\2\ft } 

+ E[\Xt(x)\2\ft}  - 2E[Xt+3(x)Xt(x)\Ft] 

= E[\Xt+s(x)\2\Ft } + E[\Xt(x)\2\Ft } - 2 AsXt(x)Xt(x). 


Taking  expectation  operator  it  follows 

£[|A'l+,(x)  - A'«(x)|2]  = £[|A'1+<(*)|2]  + £(|A',(i)|2]  - 2E[A,X,(x)X,(x)] 

= £[|*t+,(x)|2]  - £[|A',(x)|2]  - 2E[(AS  - I)X,(x)X,(x)]. 


For  a partition  {t0,  t\, 2n},  0 = t0  < t\  < . . . tn  = t,  of  [0,  t]  the  previous  equation 

implies 

n 

X = B[|X«(x)|2]  - £[|A'0(x)|2] 


2=1 


-2  J2E[(AAt,-I)Xt(x)-Xt(x)\ 


2 = 1 


= E[|A'«(x)|2]  - £[|A„(.r) 


2 X E[- 


Aau  - I 


i=  1 


A U 


Xt(x)  ■ Xt(x)]A U 


Let  now  x € D[A*).  Observe  the  following 


|£[( 


-4a;,  - I 
XU 


)Xu(x)  ■ At,(x)]  - E[Xtt(A*x)Xu{x) 


(3.12) 


= 1 E[Xu(A-^u  1 x - A*x)  ■ Xt,(x)\ | 

< (E[\Xt.(A*A:\~  1 * - A*)|2])1/a(£[|A't,(*)|3])1'3 


At 


At  At.  — 1 


< ( sup  £’[||  AT||2])||a,||  ||  — —x  - A.x\\. 


0 <s<t 


At i 


If  we  now  combine  (3.12)  and  (3.13),  the  result  follows. 


(3.13) 

□ 


APPENDIX  A 

INTEGRATION  OF  FUNCTIONS  TAKING  VALUES  IN  DUAL  BANACH  SPACE 


Suppose  (D.JF, p)  is  a measure  space  with  positive  finite  measure  p.  Let  X 
be  a Banach  space  with  its  dual  X*.  We  shall  call  a function  / : il  — > A"*  weakly 
measurable  if  the  numerical  (complex)  valued  function  </,£>:  0 —>  C is  measurable 
for  every  x £ X.  (Here  and  in  what  follows,  < /,  x > denotes  canonical  paring  between 
f(a)  £ A"*  and  x £ X,  i.e.  < /,  x > (tu)  =<  f{tx>),x  >=  (/( u>))(x).) 

Definition  6.  Function  f : D — » W*  is  called  weakly  p-integrable  if  for  every  x 6 X 
the  numerical  function  < /,  x >:  D — > C is  / i-integrable , and 

sup  / | < /( u>),x  > | /j(duj)  < oo. 

Nl<i  J 

Remark  9.  Since  < /, x >£  Lx(p)  it  is  implicitly  assumed  that  < /, x > is  measur- 
able, i.e.  that  f is  weakly-measurable. 

Now,  for  every  weakly  /i-integrable  function  / : 0 — / A"*  we  define  J fdp  £ X * 
as  follows.  From  \ | < /( lo),x  > \/j,(du>)  < A'||a;||,  for  all  x £ X,  it  follows  by 
integrability  of  < f,x> 

| J < f,  x > dp | < K\\x\\ 

for  all  x £ X.  The  functional  x — > f < /, x > dp  is  obviously  linear,  so  it  is  in  A*. 
This  element  of  A"*  will  be  denoted  f fdp  and  called  integral  of  / : D — > X*  w.r.t. 
p.  Hence,  by  definition  we  have 

( J fdp , x)  = J (/,  x)dp 

for  all  x £ X.  We  shall  sometimes  write  E[f]  (element  of  A"*)  and  E[<  /, x >] 
(element  of  C)  for  J fdp  £ X*  and  J,/, x > dp  £ C,  respectively,  especially  when 
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f.i  is  a.  probability  measure.  In  this  notation,  < j f dp,  x >=  f < /,  x > dp.  can  be 
written  as 

<£[/],*)  = £[(/,*)] 

for  all  x E X. 

For  an  arbitrary  .4  E T and  / a weakly  /r-integrable,  /I4  is  also  weakly- 
measurable  (<  f l a,  x >=<  /,  x > I.4),  and 

sup  / | < JIaix  > | dp  = sup  / | < /, x > \dfi  < sup  / | < /, x > \d/i  < 00 
Nl<i  J IMI<i  Ja  IN|<i  ./ 

implies  that  /Ia  is  weakly-integrable  as  well,  f flAdfJ-  will  sometimes  be  denoted 

jjdf-i.  Also,  for  / a weakly  /r-integrable  function,  the  map  x — ><  /, x > from  X to 

ZAlp)  is  a continuous  linear  operator.  Indeed,  f \ < /,  x > — < /,  x'  > | t/p  = J | < 

/..;■  — > | d/j  < A ||.r  — ,r'||,  and  trivial  observation  of  linearity  proves  the  claim. 

Actually,  we  can  prove  more 

Lemma  4.  Let  Q C X be  a a -subalgebra.  If  f : fl  -4  X*  is  weakly  fi-integrable,  then 
x — » E[<  f,x  > \Q]  is  a continuous  linear  operator  from  X to  L1(p). 

Remark  10.  Since  < f,x  >€  L1(p)  for  all  x E A",  the  conditional  expectation  is 
well-defined  by  the  R-N  theorem. 


Proof.  For  x , x'  E A we  have 

E[\E[<  f,x>  \Q]  - E[<  f,x'>\Q)\\ 

— E[\E[<  f.x  > — < f,x'  > |Cy]|] 

= E[\E[<  f,x-x’>  \g]\] 

(A.l) 

<E[E[\<f,x-xl>  \\G]] 

= E[ | < f,x  - x'  > |] 

< A 1 1 a;  — z,||. 


The  last  inequality  follows  from  supn^j^j  J | < /,  x > \ dp  < -do  by  definition  of 
/./-integrability  of  /.  □ 
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Observe  that  every  Bochner-integrable  function  / : H — > X*  is  integrable  in 
the  above  sense.  Indeed,  f is  strongly-measurable,  so  it  is  weakly-measurable,  and 
J\\J\\dp  = A'  < oo  implies  J|  < /,  x > \ dp  < J ||/(cu)|| \\x\\p(dui)  = ||x||  J ||/||d/i  = 
A'||x||  for  all  x € X.  Actually,  we  see  that  we  need  only  to  assume  ||/||  € L 1(p)  and 
the  result  follows.  In  particular,  every  bounded  / : 0 — >■  X*  such  that  u — »■  ||/(cu)|| 
is  Borel-measurable  is  integrable  in  this  sense. 

If  we  define  a partial  order  on  X*  by  points,  i.e. 

x*  < x2  if  | < x*x,x  > | < | < x*2,x  > | 

for  all  x € X,  then  / < g and  g weakly  /i- integrable  implies  that  / is  also  weakly 
/i-integrable,  provided  it  is  weakly-measurable.  Indeed,  J|  < /,  x > \dg  < J | < 
<7, x > | d/j  < A’||x||. 

As  a last  note  before  we  define  conditional  expectation,  let’s  prove  the  follow- 
ing 

Lemma  5.  Suppose  X is  sepai'able  and  f : 0 — > X*  is  weakly  g-integrable.  If 
fA  fdp  = 0 for  all  A € IF,  then  f = 0 g-a.e. 

Proof.  0 =<  fA  fdp,  x >=<  f flAdg,x  >=  f < flA,x  > dp  = fA  < f,x  > dp, 
for  all  a;  6 A"  and  all  A € T.  Hence,  < /,  x >=  0 p- a.e.  for  all  x € X.  Since  X 
is  separable,  if  we  denote  {x\,X2, . . . } dense  countable  subset  of  X we  have  p- a.e. 
< f,xn  >=  0 for  all  n E N,  and  it  follows  on  the  set  Ho  C fl  of  full  measure  that 
ll/MII  = supneN  | < /( uj),xn  > | = 0,  so  / = 0 //-a.e.  Hence,  / = 0 p- a.e.  □ 

For  example,  if  X — 60(A)  where  A is  a locally  compact  Hausdorff  second 
countable  space,  the  above  will  hold  true. 

Now,  we  turn  to  the  definition  of  conditional  expectation  of  a weakly  p- 
integrable  function  /:!!—>•  A"*  w.r.t.  (7-subalgebra  Q C IF. 


Definition  7.  Let  f be  weakly  / i-integrable . If  there  exists  weakly-measurable  g : 
Q — > X*  such  that  for  every  x £ X < g,x  >=  E[<  f,x>  \Q],  then  g is  called  weak 
conditional  expectation  of  f : Q — > A'*  w.r.t.  Q.  We  write  g = E[f  \Q\. 

Remark  11.  Observe  that  E[<  /,  x > | Q)  is  well  defined  since  < /,  x >£  Ll(p).  Also, 

< g,x  > is  p-almost  uniquely  defined  for  every  x £ X. 

If  g is  weakly  //-integrable  and  unique  //-almost  everywhere,  we  shall  call  g 
simply  the  conditional  expectation  of  / w.r.t.  Q and  write  g = E[f\Q].  If  X is 
separable,  it  will  be  true. 

Proposition  15.  Let  f be  a weakly  p-integrable,  and  g a weakly-measurable.  Then 

< g,x  >=  E[<  f,x>  | Q\  g-almost  everywhere  for  all  x £ X if  and  only  if  g is  weakly 
Q -g-integrable  and  fA  gdp  = J 4 fdp  for  every  A £ Q. 

Proof.  (Only  if.)  E[|  < g,  x > |]  = £(|£[<  f,x  > |5]|]  < £[E[|  <f,x>  \ 6]]  = E[|  < 
f,  x > |]  < h \\x\\  for  all  x £ X,  so  g is  weakly  //-integrable.  Now.  let  A £ Q arbitrary. 
From  < g,x  >=  E[<  /, x > \ Q\  we  have  E[<  g,x  > 1 ,4 ] = E[<  /, x > I.4].  Then  E[< 
gl.4,x  >}  = E[<  /lyi,.T  >]  for  all  x £ X.  We  already  observed  that  if  a function  h is 
weakly  /r-integrable,  so  is  hl^  for  every  A £ IF.  Hence,  < E[glA],x  >=<  E[/1a],x  > 
for  all  x £ X,  i.e.  E[glA\  = E[flA\. 

(If.)  Suppose  jA  gdp  = JA  fdp  for  all  A £ Q.  Then  by  definition  of  f\A 
and  g\A  we  have  f < glA,x  > dp  = f < fla,x  > dp  for  all  A and  all  x.  Since 

< g,x  >£  Q for  every  1 £ X we  have  by  definition  of  conditional  expectation  in  C 

< g,x  >=  E[<  f,x>  | Q]  //-almost  everywhere  for  every  a;  £ X.  □ 

Hence,  the  definition  of  conditional  expectation  can  be  restated  in  the  fol- 
lowing way:  A ^-measurable  weakly  //-integrable  function  g is  the  weak  conditional 
expectation  of  a weakly  //-integrable  function  / w.r.t.  Q if  fA  gdp  = /4  f dp  for  every 
A £ Q.  By  the  previous  lemma  we  know  that  g is  unique  //-almost  everywhere  if  X 
is  separable.  In  general,  only  < g,x  > will  be  unique  p- a.e.  for  every  x £ X. 
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Remark  12.  If  A : X — y X is  a bounded  linear  operator  and  f weakly  p-integrable 
function,  then  A*  f is  also  weakly  p-integrable.  Furthermore,  if  f is  weakly  Q -measurable 
for  some  a-subalgebra  Q C T the  same  statement  holds  true  for  A* f.  Indeed,  by  def- 
inition of  A*  we  have  < A*f,x  >=<  f,Ax  >,  and 

I 


< A* f,x  > \dp  = / | < /,  Ax  > | clp  < I\ 


< I<\ 


APPENDIX  B 

LINEAR  OPERATORS  ON  A BANACH  SPACE 


In  the  following  we  suppose  X and  y are  Banach  spaces,  and  X*  and  y*  are 
their  respective  dual  Banach  spaces.  Let  L(X,y)  stand  for  the  vector  space  of  all 
continuous  linear  maps  from  X to  y.  For  an  operator  .4  £ L(X.y)  we  shall  denote 
A*  its  adjoint  operator  acting  on  y*  and  taking  values  in  X* 

A*{y*){x)  = y*(A(x)). 

Then  we  have  the  following 

Theorem  11.  An  operator  A from  y*  to  A'*  is  an  adjoint  of  an  operator  A * £ 
L(X,y)  if  and  only  if  A is  wk*  — continuous. 

Proof.  Suppose  first  that  A = (A*)*.  Let  y*  — > 0 in  wk*— topology.  Then  (Ay*)(x)  = 
y^(A(x))  converges  to  zero  because  y*{y)  -4  0 for  every  y £ y* . Conversely,  for  every 
x £ X we  have 


sup  \{Ay*)(x)\  = sup  \y*{A{x))\  = \\Ax\\  < oo 

Ih'IIS1  llv*  ll< 1 

so  by  the  Principle  of  Uniform  Boundedness  it  follows  that  sup^.^j  ||Ay*||  < oo,  i.e. 
A is  a bounded  operator  in  L(y*1X*).  Then  its  adjoint  A*  : X**  — > 3/’**  is  bounded 
as  well,  and  by  natural  embedding  X ■— > A"**  we  can  write 

(A*(x))(y*)  = x(A(y*)) 

= (A{y*))(x). 

Now,  if  we  define  A*  : X — > y by 

(A,(x))(y“)  = (A(y*))(x ) 
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for  all  y*  £ JL  it  follows  A* jX  — A,  and  (A*)*  = A. 


□ 


Theorem  12.  For  any  Banach  space  At,  its  dual  X*  equipped  with  wk*  — topology  is 
sequentially  complete. 

Proof.  Let  x*  € X*  be  a sequence  such  that  ( x*n  — x*m)(x)  = x*n(x)  — x*m(x)  converges 
to  zero  for  all  x 6 X as  n,m  — > oo.  Then  by  the  completeness  of  C we  can  define  a 
linear  map  x*  : X t— >•  C by 

.r*(.r)  = lim  x*(x) 

n—toc 


for  all  x £ X . Now,  it  follows  from  the  Banach-Steinhaus  theorem  that  x * £ A’*,  and 
hence  x*  — > x*  (wk*).  □ 


APPENDIX  C 

THE  EQUI-CONTINUOUS  SEMI-GROUP  OF  CLASS  (C0)  IN  LOCALLY  CONVEX  SPACE 
In  the  following  we  adhere  [4]. 

Definition  8.  Let  X be  a locally  convex  topological  vector  space,  and  {T(;  t > 0}  be 
a one-parameter  family  of  continuous  linear  operators  Tt  : X t->  X such  that 

TtTs  = Tt+S  , To  = / 


and 


lim  Ttx  - Ttox 

t—tto 

for  any  t0  > 0 and  x € X.  The  family  of  mappings  {T(}  is  said  to  be  an  equi- 
continuous  semi-group  of  class  (Co)  if  .for  any  continuous  semi-norm  p on  X , there 
exists  a continuous  seminorm  q on  X such  that  p(Ttx)  < f/(x)  for  all  t > 0 and  all 
x <E  X. 


We  give  the  following  theorem  without  the  proof. 


Theorem  13.  Let  X be  a locally  convex  topological  vector  space  ivhich  is  sequentially 
complete,  and  {Tt;t  > 0}  be  an  equi- continuous  semi-group  of  class  (Co)  acting  on 
X.  Define  the  infinitesimal  generator  A of  {Tt}  by 


Ax  = lim 
Ho 


(Th  - I)x 
h 


for  all  x € X for  which  the  limit  exists  in  X.  Call  the  set  the  domain  D(A)  of  the 
infinitesimal  generator  A.  Then  D(A)  is  dense  in  X. 
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